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ABSTRACT 

Beginning college physics students" misconceptions 
about moving objects, their mathematics skills, and formal reasoning 
ability, are all believed to be related tp their' achievement in 
physics. It is hypot)iesized that students whose knowledge structures 
include misconceptions that are in conflict with concepts In the 
lectures and text will have difficulty in learning classical 
mechanics. Multiple regression analysis of scores on tests of 
mathematics skills and formal re«^«oning ability confirmed that no 
linear relationship exists between' these independent variables and 
scores on a classical mechanics exam., However, an index of 
misconceptions about moving objects accounts for greater variance in 
classical mechanics exam scores. (Author) 
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Introduction 

IXjring the past deci-ue rri'joh attention in the physics education 
community h^*»te§en turned to the problems surrounding the learning and 
teaching of introductory physics for the non-physics major. Within the 
domain of introductory physics, the teaching of classical mechanics is a 
focus of special concern. It is generally agreed that mechanics, often 
the - first subject treated in introductory courses, is especially 
troublesome for many students. 

Educators cite various reasons for this apparent opacity of 
pLysics, and especially mechanics, to many students, and have suggested 
and attempted various resolutions of the difficulty. Many variables 
that may contribute to students' success in learning physics have been 
explored, at least tentatively. Foremost among these are (1) 
mathematical skills, (2) general level of cognitive development, (3) 
specific cognitive processes, and (4) content preconceptions. Measures 
of student success in physics reported in the literature also are 
diverse. Final grades, scores on specially designed tests of content 
knowledge, ability to solve certain problans, and even the attainment of 
"formal" cognitive operations all have been used as output measures. 
, It is apparent from even so brief a listing as this that, if one hopes 
to sort out those factors that influence students' successful learning 
of introductory physics, careful analysis of both input measures, 
instruction, and output variables, and systematic analysis of the 
interactions between variables are required. 

Consider, for example, the input variable, mathematical skills. 
For many in the physics community, the assumption that proficiency in 
mathematics provides the necessary and, perhaps, sufficient condition 
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for success in learning physics has guided practice for quite a few 
years. Some recent studies have attempted to assess how firm the grounds 
for this belief are. As part of a larger project to determine factors 
that correlate with success in learning physios, Cohen, Hillman and Agne 
(1978) fo.und, not surprisingly, that SAT mathetnatics scores correlate 
highly both with the level of the physids course (they included four 
courses, from a survey course to one requiring calculus) and with final 
grades in the course. These authors admit that "final course grade may 
not be the best measure of actual achievonent in physics" and they plan 
to use standardized achievement tests in a future study. But what is 
missing in both final course grades and standardized tests is that the 
outcome measure is not adequately specified in terms of the cognitive 
requirements of the F*iysics courses. It is also typical in such 
studies to find only a mere mention of the textbook used and the bare 
information that a course was taught "in the trac -ional way." 

Hudson and Molntire (1977) attempted a more refined analysis of the 
algebraic and trigonometric "tools" presumably needed Jn a non-calculus 
physics course. These tools were: (1) linear algebraic equations in 
one unknown, (2) parametric equations in tvto unknowns, both linear, (3) 
parametric equations in two unknowns, one a quadratic, (M) graphical 
analysis, (5) quadratic formula, (6) Pythagorean theorem, (7)- (9) 
definitions of sine, cosine, and tangent. On the basis of this analysis 
they prepared a diagnostic instrLjment which was administered prior to 
the beginning of instruction, and compared scores on the pretest with 
final course grades. They report that the test was a better predictor 
of a probability of failure than of "success," and they conclude that 
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••mathematical skill is only one of the several factors necessary to 
physics, and a high score on the mathematics test is no guarantee of 
success in physic'sJ' Although their conclusion is probably correct with 
respect to the importance of mathematical skills, we are still left with 
a nunber of questions: Are the nine prerequisite skills they identified 
adequate and complete? Are they actually required in the course? We 
have no way of judging these matters from the author©' descriptions. To 
what extent was proficiency with these skills related to the final 
grades? '• ♦ 

The traditionally held belief that - there is an important 
relationship between mathiematical skills and physics success has been 
supplemented, by^some educators vilno view as appropriate the application 
of" recent developments in cognitive psychology "to the concerns of the 
physics instructor. These investigators have approached the problem in 
various ways. Some have drawn upon the work of Piaget and his theory of 
cognitive development. Others have taken up an information processing 
psychology perspective and have attempted to analyze and specify the 
cognitive skills required to solve certain physics problems. Still 
others have attended to the conceptions about physics that students 
bring to their study of physics courses. 

Judging from the volt*ne of reports dealing with the subject, a 
particularly attractive idea to many has been the notion, derived from 
Piaget 's work and supporters of hib cognitive developmental framewDrk, 
that a prerequisite for success in the learning of physics is the 
attainment by the individj. of "formal" modes of reasoning. ''Formal" 
cognitive operations can be variously defined ir either technical or 



general terms. The literature dealing with post- secondary physics 
education usually provides non-technical specifications of components o.f 
formal reasoning, such as the following list supplied- by Ar on s (1976): 
••the capacity to do elementary syllogistic reasoning • involving 
inclusion, exclusion, and serial ordering; discriminate between 
observations and inferences; recognize incompleteness of informntion \n 
a line of reasoning; do inductive reasoning in the development of a 
scientific model and deductive reasoning in predicting consequences 
of the model; engage in hypothetico - deductive reasoning; do 
arithemetical reasoning, particularly involving the consequences of 
division of one nunber by another." 

Ntore technical definitions (see Piaget & Inhelder, 1969) include a 
description of what Piaget calls (1) the combinatorial system and (2) 
the INRC group. The meaning of Piaget' s elaboration of formal 
operations, it should be noted, has itself been the object of serious 
critiques (see, for exanple, Innis, 1975). This is an important 
consideration for .wo reasons. First, some researchers have tried to 
validate paper-and-pencil measures of formal operations by arguing that 
those tasks probe for the operations elaborated in Piaget 's theory (for 
example, Phillips, 1977). Second, many investigators rely upon the 
tasks developed by Piaget and his co-workers, tasks which are 
administered in a clinical interview fashion (see Chiapetta, 1976), and 
it is the relationship of these tasks to the "formal operations" that 
has been criticized. 

Not only are there various definitions of formal operations and 
various probes into formal thought; there are also studies that explore 
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the relationships of cognitive level to success in introductory physics. 
These fall into three broad categories: (1) those, (which will not be 
reviewed here) that assume that physics courses must be modified to 
accomodate those students not exhibiting formal operational thought 
(Arons, 1976); (2) tho^e that retain a "traditonal" mode of physics 
course and try to correlate cognitive level of development with success 
in the course; (3) those that have compared success between courses 
taught "traditionally" and those modified 'for pre-formal students. In 
all three groups there is a common agreement in the observation that, 
regardless of which assessment methods are used (pa per- and- pencil tasks 
or clinical interviews) , from one-third to one-half of the students 
taking introductory physics are operating below the lurmal level. 

; 'o studies have been conducted to date that challenge the 
assv-.. of educators in group 1 (see above) that traditional courses 

must be modified. ■ Cohen, Hillman, and Agne (1978), whom we have 
mentioned earlier, studied the correlation between cognitive level of 
developnent and final grade in a range of physics courses. Clinical 
interviews were conducted to establish cognitive levels. Their data led 
them to conclude that there is "little correlation between Piagetian 
level and success in physics courses." Barnes (1977), studying six 
lower-division physics courses, correlated results from a 
paper-and-pencil test with final course grades and found that the two 
were weakly correlated. In both of these studies, the weaknesses of 
"final grade" as an output measure are evident, and in neither are we 
provided with an analysis of the pl-iysics courses. 

In addition to those educators who draw upon the Piagetian 



framework, a few have looked for new ideas to another area of cognitive 
psychology, specifically to't-he information processing approach. A key 
feature' of this perspective ' is a focus on the specification qX the 
knowledge and cognitive operationsv.required for the solution of physics 
problems. Also, in this perspective it is assumed that knowledge is 
Stored in memory as knowledge structures\and "that success in solving 
problems is related to the "richness" these structures and to the 
ability of the individual to "access" them. F^r exanple, Reif, Larkin 
and Brackett (1976) have analyzed the skills required to understand a 
relation, definition or law in physics and sofee of the tasks 
(strategies) needed to solve a physics problem. They hp ve attempted to 
teach these skills to students and have concluded, tentatively, that it 
is possible to teach these skills and, also, that students so '^aught are 
more successful problem solvers than those who were not taught. \Notice 
that in this line of research the output measure is clearly speciT^ed 
and is expressed in terms (problen solving) that most physicists would.^ 
feel comfortable with. Still to be determined however, are how the \ 
expected range of incoming students' abilities in problem solving 
relates to students' success in physics courses, and how the students' 
knowledge of the physical world (as opposed to problem- solving skills) 
influences their performance. It is this lasi interaction that ha;; 
caught the attention of a nunber of investigators. 

Clement (1977), Nussbaun and Novak (1976), Leboutet-Barrell ( 1976), 
and Waern (1977) have postulated that on the basis of 
common-sense-world experiences, students often develop understandings of 
the physical world which are strongly held, and that these conceptions 
will interfere with the learning of new conceptual relationships during 



physics instruction. These conceptions usually are not entirely 
isolated ideas but, rather, ar« incorporated in conceptual structures, 
the whole or large parts of which i"nust be modified during the course of 
instruction. One goal of research that follows this line, then, is to 
probe for students' conceptions, as well as to reveal the structures of 
the conceptions and the modifications in these structures as a result of 
instruction. . 

For exsmple, Clement (1977) studied and catalogued the 
precoftqxeptions of college students in the domain of classical mechanics 
(specifically, the relation X F = ma) . He argues that many 
preconceptions fall into a pattern that may be summarized as a belief 
that ^'motion implies force." He concludes that, "The wide diversity of 
situations shown here in which this system of preconceptions surfaces is 
indicative of its /pervasive nature^" This suggests that the system is 
deep seated and is one source of the difficulties encountered by 
students in understanding the physical principles associated with the 
equation HF = ma. 

The empirical studies reviewed strongly implicate mathematical and 
reasoning skills as important input variables to the learning of 
classical mechanics. Theoretical papers suggest that conceptions about 
the motion of objects that students bring to instruction will influence 
the learning process. However , .each of the studies cited describes the 
influence of a single input variable on an output measure of physics 
achievement that is not well specified. Hence, little empirical 
information is now available concerning the combined effects of the 
input variables of mathematical skills, reasoning skills, and 
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oonceptions about motion on a well- specified output measure for 
classical mechanics. 

The study described in this paper represents an attempt to 
contribute data about the combined effects of pertinent input variables 
on student achievenient in mechanics. Our purposes are:(l) to describe 
in some detail the preinstructional knowledge of mechanics, 
mathematical skills and reasoning skills of a sample of college physics 
students; (2) to relate these input variables to the students'* success in 
learning classical mechanics; and (3) through an analysis of the 
instruction the students received, to generate some hypotheses about 
causal relationships that exist between the input variables and output 
measure . 
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Procedure 



Setting and Sample 

This study was conducted during the Fall 1973 Term in the context 
of an introductory college physics course, Physics 10, a regular 
3-credit offering in the College of Arts and Sciences at the University 
of Pittsburgh. The Physics 10 course begins a two-term non-calculus 
sequence designed for students who do not major in either physics or. 
engineering. Instruction in Physics 10 is given in three large-group 
(100-125 students) lectures and one small-group (15 to 25 students) 
recitation section per week. The course does not include any laboratory 
sections, and the students themselves do not perform laboratory 
exercises, but numerous demonstrations are performed in lectures. 
Apparatus used in the demonstrations is made available in an "open lab," 
where the students may voluntarily carry out any manipulations they 
wish. In the 15-week Fall 1978 Term, there .,fere 3 one-hour midterm 
examinations and a comprehensive 2 1/2 hour final examination. 
Mechanics was the subject-matter of the Physics 10 course from the 
beginning of the term through the second hour exanination. 

The instruction In mechanics was designed with careful deliberation 
by the course instructor, a full professor who has had many years 
experience in teaching Physics 10 and other introductory and advanced 
courses. At the beginning of each major segment of the study of 
mechanics, the instructor gave the students an outline of the principal 
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points to be covered in that segment. TYie subsequent lectures 
fdithfully followed the outline of principal points. In '-addition to 
•assigned -readings in the textbook, Camow, 1976, the students were 
expected to complete homework problem, sets at the rate of approximately 
2 sets every 3 weeks. The students also were given Home Exans, which 
contained questions similar to those on the hour examinations 
administered in class. After the students submitted their Home Exans on 
a specified date, model answers to the questions were posted, and the 
students were obliged to submit a corrected version of t:ieir Home Exans. 
To assist the students vath . their homework problems and Ftome Exan 
questions on an individual basis, the instructor maintained an extensive 
schedule of office hours. In some weeks, as many as 10 to 12 hours were 
devoted to these individual tutoring sessions. In addition, group 
review sessions for any student who wished to attend were scheduled in 
the week prior to each of the two hour exaninations on mechanics. All 
in all, not only was the instruction carefully designed, but the 
instructor also provided various kinds of support to help the students 
in their study of mechanics. 

The students v/ho enroll in the Physics 10 course tend to be quite 
heterogenous in their backgrounds and major interests. The sample of 
110 Physics 10 students included in this study consists o.f ^15 males 
i^2%) and females (53*). The distributions of their years in college 
(1st year, 2nd year, etc.) and college majors are shown :.n Table 1. The 
distributions of the nimber of years of science studied in high school 
and the number of years of mathematics studied in high school are shown 
in Table 2. Physics was not studied in high school by 32 students 
{291>), while 63 students (52^) rep ted one year of high school physics 
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and y students reported ts^^ more years. The distributions of 
the number of previous'credits earned in college science courses and the 
nunber of previous credits 'earned in college mathematics courses are 
shown in Table 3. None of the information describing the students in 
^"he sample shows any remarkable trends, but their diversity is 
noteworthy.* 
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Instrunents 

r * 

• » 

A pre-instruDtional assessment of the students in the Physics 10 
course was obtained from the administration of three instrunents, 
viz> , the Demonstration, Observation, and Explanation of Motion Test, a 
Logical Reasoning T6st, and a Mathematical Skills Test. The success of 
the Physics 10 students in mastering classical mechanics was assessed by 
the first two Hour Exaninations and by a portion of the Final 
Exanination. Descriptions of all six instruments follow. 
' Demonstration, Observation, and Explanation of Motion Test 

The Demonstration, Observation and Explanation of Motion Test, the 
first part of the pre- instructional assessment, has the purpose of 
exploring Doth the students' pre- instructional conceptions of , certain 
aspects of classical mechanics and the modes of reasoning which students 
apply when confronted with problems in a physics context. ' In this 
test, which consists of seven sections, A through G, ^'5tudents are a;Sked 
to observe the motion of physical objects, in vari9us situations. They 
are directed to describe their observations, answer questions about the 
motion ot' the objects 7 and"i:hen provide expl an ations^"ror th'5^i"r" "answer sr. 

The test administrator conducts the demonstrations for the students 
and the students record theii^ responses in an answer booklet. A copy of 
Che questions included in the answer booklet is provided in Appendix A. 
Two major pieces of apparatus are used: (Da wooden, 100-cm high pole 
with colored markers (see Figure la) for sections A, B, and D; and (2) a 
simple version of the Atwood machine (see Figure lb) for sections C 
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through G. 

The demonstration performed, in each section of the test and the 
responses which the students are asked to make are described below, 

Sectit;)n3 A and B - Free Fall . For both of these sections the 
'students .observe and give explanations for 'the motion of objects in 
free fall. The test administrator holds objects next to the red marker 
on the wooden pole (Figure- la) and then releases them. The students are 
asked to describe the objects' motion, using the blue and green colored 
markers on the wooden pole as reference points. Section A deals with 
the motion of a single obj^t, a chalkboard eraser. (see Appendix A, 
questions .A1 through A6). - The students are asked to explain what sets 
the eraser in motion when it is released (question A1, 2, 3) and " to 
describe their observation of the eraser's speed as it passes the blue 
and green markers (questions A4, 5, 6). In section B, the students 
observe, compare and explain the freefall motion of two rectangular 
prisms of equal volume (4.5cm x 1.5cm x 1.5cm) but different mass, an 
aluninun block (mass = 32g) and a lucite block (mass = 13g) (see 
A,ppendix A questions 81, 2, 3). 

Section C - At wood Machine (system static) . For Section C 
through G, the Atwood machine, a standard piece of apparatus irv the 
teaching of classical mechanics, is used. The arrangement used here 
(see Figure lb) consists of a pulley, a pulley support, a nylon string, 
a plastic bucket containing sand, and a wooden block. The test 
administrator can vary the mass of the bucket by adding or removii ^ 
sand. Prior to demonstrating Section C, the administrator prepares the 
bucket of sand so that its mass equals the mass of the block. In the 



demonstration, the string holding the bucket and block is placed over 
the pulley with the bucket of sand suspended at a level higher than the 
block. The students are asked to compare the weights of the bucket and 
block (questions CI, 2, 3). ' 

Section D - Atwood Machine (syst em in motion) . TTiis section has , 
four parts. Initially the Atwood machine is arranged as in Section C, 
the bucket of sand and the block having equal mass> the bucket suspended 
at a level higher than the block. 

t 

Part D. I. - Fifteen Grains of Sand (questions Dl, 2', 3). The 
administrator tells the students that he is about to add 15 grains of 
sand to the bucket (i.e., a small enough mass that the bucket will not" 
be accelerated), and asks the students to report ' their predictions of 
what will happen. The administrator th'en adds the sand, and the 
students record and explain their observations. 

♦ Part D. II. - One Scoop of Sand (questipns DM, 5).. Continuing 
with the setup from Part I, the administrator adds 1 scoop of sand to 
the bucket. The bucket now accelerates downward. The students record 
any diffeYences thoy obsvarved between the. two instances of adding 15 
grains of sand and 1 scoop of sand to the bucket, and they explain the 
observed differences. 

* 

Part D. III. - Speed, (questions D6, 7, 8). The administrator 
then raises the bucket to the pole's red marker and releases it. The 
students observe the bucket's descent and record their observations and 
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explanations for the bucket's speed as it descends. 

* 

Par': D. IV. - Two Scoops, of Sand (questions D9, 10). Another 
scoop of sand is added to the bucket and (as in Part D. III.) the 
bucket is raised to the red marker and released. The students observe, 
compare, and explain the differences in the speeds of the bucket with 
one and two extra scoops of sand. 

Section E - Atwood Machine (different objects of equal mass; 
constant speed) . The adminin-strator removes the two extra scoops of 
sand and sets the base of the bucket at the same level as the base of 
the block. The administrator then pushes down slightly on the bixiket so 
that it descends at a constant speed andi asks the students to compare 
the weights of the bucket and block (question El) . The students also 
respond to four multiple-choice questions concerning the forces acting 
situation (questions E2 through 5). 

Section F. - Atwood Machine (cylinders of equal mass; constant 
speed) . In sections F and G, two weighted plastic cylinders of equal 
mass and joined by a nylon Sitring replace the bucket of sand and the 
wooden block on the Atwood machine. The test 'administrator suspends the 
two cylinders at the same level and then pushes upward on the bottom of 
one of the cylinders. The students are asked to explain why the 
cylindGi which was not pushed moves downward, and why the cylinders 
continue in motj.on after the push stops (questions Fl, 2). 

Section G Atwood Machine (tran sfer of string and cylinders) . For 
this final section, the test administrator removes the tv« cylinders and 
string from the pulley of the Atwood machine and transfers them to the 
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pulley of another machine. In this set-up, the pulley is attached at 
the end of il5cm-long board which lies horizontally on a table. The 
pulley extends over the table's edge and its turning axis is parallel to 
the floor. In this machine, instead of the cylinders hanging 

vertically below the pulley as on the Atwod machine, one hangs 
vertically below the pulley and one rests on the horizontal board. 

After transferring the string with the two cylinders to the other 
inachin.e*s pulley, the administrator holds the cylinder at the far end of 
the board and asks the students to predict wliat will happen wJien the 
cylinder is released. When the students* predj.ct ions have been 
recorded, the cylinder is released, and*, the students compare their 
observations with their predictions (questions G1, 2, 3)» 

Logical Reasoning and Mathematical Skills Tests 
♦ ■ . 

The pre- instructional assessment also included two additional' 
instrtfnents, which probe the students logical" reasorfing ability and 
mathematical skills, respectively. Both of these instrunents are 
administered to the students in test booklets, containing the q uest ions 
and spaces 'where students record their answers and their reasoning. i3oth 
tests are administered without a time lijnit. 

The Logical Reasoning Test contains 10 questions. The maximun 
possible score is 10 points. The questions require the student to apply 
logical reasoning to verbal and diagrammatic representations of physics'' 
world situations. Three of the questions refer directly to aspects of 
p'lysics. Four questions require the use of proportional reasoning 
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skills, and three are a slightly modified version of the Karplus Islands 
Puzzle (Karplus & Karplus, 1970), which purportedly tests for aspects of 
formal reasoning (see Blake, Lawson, & Norland, 1976 for a critique of 
the Islands Puzzle). 

The Mathematical Skills Test contains twelve questions, most with 
subparts. The maximim possible score is 35 points. The several 
questions test for the following classes of mathematical skills: (a) 
conversion of nunbers from scientific notation to ordinary notation and 
from ordinary notation to scientific notation; (b) determination of 
nunerical relationships among line segments and angles in similar and 
congruent triangles; (c) application of the definitions of sine, cosine, 
and tangent to do calculations in right triangles; (d) conversion of 
quantities from one, unit to another; (e) proportional analysis of 
. variables from an' equation expressing a functional relationship; (f) 
matching a verbal description of a functional relationship with an 
equation that formally expresses the relationship; (g) writing equations 
that express direct ari indirect relationships between variables x and 
y; and (h) analysis of a displacement-time graph. 

First and Second Hour Examinations and Final Examination 

The two hour examinations were designed to assess the students' 
mastery of classical . mechanics, aS- was a portion of the Final 
. Exaiiination. The First Hour Exarlination was r-'.dministered to" the students 
in a lecture period during the fifth week of the course, and the Second 
ibur Examination was administered in the same way during the ninth 
week. Two equivalent forms of each Hour Exaiiination were prepared, "ihen 
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the examination was administered, students seated in alternate seats 
received the blue form wliile their neighbors on both sides received the 
green form. The time allo'wed for students to complete each of the Hour 
Exaninations was 50 minutes. 

Both the First and Second Hour Exaninations contain several types 
of questions and assess the students on several behaviors with respect 
to the subject matter of classical mechanics. The question types 
include , true-false items, multiple-choice items, and questions where 
the student supplies short written answers. However, the princjipal type 
of question, which accounts for ^0% to 50% of the total examination 
score, presents a quantitative problem in mechanics and requires the 
student to find a nums. ical solution. The several questions call upon 
different behaviors on the part of the students answering them. These 
student behaviors, classified according to the specifications devised by 
Klopfer (1971), provide a means for exanining the level of understanding 
assesed by a test instrument. For the First and Second Hour 
Exaninations, the student behaviors with repsect to mechanics that are 
assessed, the number of points assigned to each student behavior class, 
and the percentage of the total examination score represented by each 
student behavior class are shown in Table 4. Evidently, the principle 
emphasis in both Hour Examinations is on the student behavior of 
application. 

The 14 questions on the Final Examination that deal with mechanics 
are all of the multiple-choice type. Nevertheless, six questions 
present quantitative problems requiring numerical solutions, and two 
other questions pose non-quantitative mechanics problems new to the 
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Students. The relative emphasis on the several behaviors assessed by the 
mechaincs questions on the Final Exanination are sho'wn in Table U. 
Again, as for the two Hour Examinations, the principal emphasis is on 
application. 

The measure of student achievement in mechanics is operationally 
defined in this stud^ as the sum of a student's three scores on the 
l> First and Second Ftour BKcninations and on the mechanics questions of 
the Final Examination-r— ^cause two different forms were used for each 
of the Hour Exa^nations, the students' actual scores on all 
examinations were converted to standarized scores (mean s 500, S. D. = 
100), and these were summed to obtain the criterion measure of Mechanics 
Achievement. 

Methods of Analysis 

Since one purpose of the present study 'is to find the relationship 
between identified input variables and students' success in learning 
classical mechanics, one necessary analysis is the determination of how 
the criterion measure of Mechanics Achievement just described is 
related to students' preinstructional knowledge, skills and. status 
variables. The relationships of interest can be investigated in the type 
of study undertaken here, in which the experimental manipulation of 
conditions was neither desirable nor feasible, by analyzing 
correlations between variables and by a regression analysis on the 
criterion measure. From the observations of physics educators reported 
in the literature (see Introduction), it is apparent that three input 
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variables likely to enter into the prediction of the criterion mearvure, 
Mechanics ■ Achievement, can be derived Irom the three instruments used 
in this study's preinstructiohal assessment, measuring, repsectively, 
knowledge and preconceptions about motion, logical reasoning skills, 
and mathematical skills. Observations and opinions of certain physics 
educators also suggest that certain other chai iteristics of students 
might enter into the prediction of the criterion. Consequently, such 
variables as the amounts of high school science and mathematics 
studies, whether or not the student studied physics in high school, and 
the student's sex become canididates for consideration in the 
statistical analyses. 

It should be recognized , .however , that all the data collected- in 
this study, are not reducible to statistical treatment, nor were they 
intended to be. In particular, the Demonstration, Observation, and 
Explanation of Motion Test administered as a part of preinstructional 
assessment yielded an answer booklet for each student containing 
several hundred words of written responses to specific probing 
questions (see Appendix A), so that these answer booklets provide a 
valuable resource for constructing descriptions of the conceptions of 
motion held by the students. These conceptions could be constructed by 
considering the 'answer booklets to be protocol records and 
systematically applying techniques of verbal and logical analysis to 
these protocols. Results from the protocol analysis are reported in the 
following Findings section, and they serve to make understandable the 
statistical results wJiich are reported first. 
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Findings 



Predictions of Mechanics Achievement Score 

The students' total scores for iMechanics Achievement, computed as 
described in the Procedures section, ranged from 8^9 to 2046, with a 
mean of 1499 and standard deviation of 248. Correlation coefficients 
between this criterion variable and nine input variables derived fVom 
the several diagnostic instrunents and student status characteristics 
are presented in Table 6, which also shows the correlation between all 
pairs of input variables. The input variable "D.O.E. Test Correct 
Score" was constructed from the students' responses given to four key 
questions on the Demonstration, Observatiou, and Explanation of Motion 
Test. As indicated in the, findings discussed in the next section, the 
four key questions on the D.O.E. Test encompass a significant ^aspect of 
a student's conceptualization of motion, so that the score derived from 
these questions is a reliable metric for this instriinent. The input 
variable "Sex" was constructed as a dummy variable with male = 1 and 
female = 2. The nunerical values for the other input variables are 
evident from their names and descriptions in the Procedures section. 

As displayed in Table 5, the Mechanics Achievement Score is 
correlated significantly with only three input variables: D.O.E. Test 
Correct Score (p < .01), Reasoning Score (p < .001), Math Skills Siore 
(p < .001). Each of these three variables is significantly correlated 
with each of the of t^e other two and with the Sex variable. (Although 
Table 5 shows some additional statistically significant correlation 

9 0 . 
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eoeff'aients between input variables, these relationships are of no 
interest for the present analysis.) Exaninations of cros5--tabulation of 
the Mechanics Achievtment Score versus each of the three significantly 
correlated input variables yielded the following further findings about 
the relationships: 

(1) Students who obtained D.O.E. Test Correct Scores (5 or more) 
generally obtai^ned scores above the mean on Mechanics Achievement (6 out 
of 7 scores), while students wtiose D.O.E. Test Correct Scores 

were low (2 or less) did not necessarily score below the mean on 
t^chanics* Achievement (37 students of 64 did). 

(2) Students who obtained high Reasoning Scores (7 or more) did not 
necessarily obtain scores above the mean on Mechanics Achievement (12 
students of 18 did), while students whose Reasoning Scores were low (3 
or less) tended to score below the mean on Mechanics Achievement (14 
out of 18 students) . 

(3) Students who obtained high Mathematical S<ills Scores (26 or 
more) tended to obtain scores above the mean on Mechanics Achievement (16 
out of 21 cases) , while students whose Math Skills Scores were low 
(13 or iess-> generally "scored- below the^mean on ~ Mechanics Achievemerst 
(12 out of m cases) . ' . 

Using the four input variables with significant intercorrelations 
identified in Table 5, . step-wise multiple regression analysis was 
carried out. The regression may be represented as: MA = DC R + MS + 
3X, where MA = Mechanics Achievement Score, DC = D.O.E. Test Correct 
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Score, R = Reasoning Score, MS s Math Skills Score, and SX s Sex. 

Table 6 gives the^ summary table for the multiple regression 
analysis and the computed regression equation. The multiple R of 0.572 
is "significant at the .01 level, and aoproximately 33% of the variance 
in Mechanics Achievement Score is expfained by the four input variables. 
The contribution of the Sex variable is not significant, however, and 
almost t,he same percentage of variance in the criterion measure is 
explained by the variances in the D.O.E. Test Correct Score, Reasoning 
Score, and t-1athe%atical Skills Score. 

Protocol Analysis 

The D.O.E. Test used in this study evolved from a demonstration- 
interview schedule developed for a previous study (Champagne & Klopfer, 
1979) to probe elementary, middle, and high school students' 
understanding of the motion of physical objects.. The use of 
demonstrations to define the problem space has two obvious advantages, 
namely: (1) the anount of verbal description necessary to set the 
parameters of the stiutaion is reduced; and (2) the open ended 
questions yield copious data on which inferences about the students' 
conceptualization can be made. These features also proved advantageous 
for use with college students. A short answer test of the same basic 
ideas appropriate for college-age students would either be highly formal 
or excessively verbal. In either case, the short answer test would not 
be a good probe for the students' conceptions, either formal or 
informal, of the causality of motion, but an opportunity to assess both 
types of conceptions is provided by the D.O.E. Test. Four of the 
questions, namely M, 31, CI, and D6, probed the students' 



24 

. (J 

understanding of the equation central to classical mechanics, F = ma. 
Table 7 presents the particular relationships of the equation that the 
physical situation surrounding each question defined. Student answers 
to these four key questions were marked "correct" if the answer was 
consistent with the formal interpretation of the^ equation, " = ma. 
Credit was given for the answer even if it was based on faulty or 
partial information or on faulty logic. 

Th^ four key questions on the .D.0.?£. Test provided a reliable 
measure of the students' pre- instructional knowledge of" mechanics. It 
had been expected initially that trte frequency of "correct" answers 
w-'uld be high and that more detailed information about the students' 
conceptualizations would be obtained from the protocol analysis. 
However, as the data in Table 8 indicate, the students demonstrated 
that they did not know the very basic relationships these key questions 
tested. These results v;ere particularly surprising since about 70% of 
the students in the sample had studied hign school pfiysic*:, some for 
years. A chi-square test showed that students in the sample who had 
studied high school physics did not score significantly better than 
those ivho had not. There are also significant sex differences in 
performance on these four key questions. . • 

Analysis of "incorrect" answers to the key questions indicated that 
approximately one in five of the students in the s.ample believed that a 
dropped object reaches an instantaneous maximum velocity and then falls 
at constant speed. About four .students in five believed that , all other 
things being equal, heavier objects fall faster than lighter ones, and 
about the same proportion of students believed that "lower (closer to 
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the earth) implies heavier." Perusal of student protocols provides 
ample -ividence of the extent to 'wh-ich these beliefs are rationalized on 
the basis of various creative, idiosyncratic misconceptions about the 
relationships among force, weight (mass), and" the motion of objects. 
Hie excerpts from student protocols in Tables 9 and 10 iliustrate these 
various misconception 3 'which rationalize incorrect beliefs about the 
motion of objects. 

Not only is the students' poor performance on the four key 
questions of the D.O.E. Test notovvorthy; it is contrary to ej^ pec tat ion". 
Pre- insr actional knowledge of a subject-matter domain is, usually a 
strong predictor of wliat is learned from instruction. I-towever, the 
result from the intercorrelation analysis (Table 5) and 
cros^-tabulations suggests that the D.O.E. Test may be tapping a 
different knowledge domain from the one tested by the mechanics items 
on tfie hour and final exaninations of the course. The next s*;-pp in t'he 
Jata analysis is based on the assumption that the propositional 
knowledge tapped by the preinstruction knowledge test is n.ot 
inconsistent witn' what was taught in the course and tejted for in the 
course's mechanics examinations. However, the preliminary^^analysis 

showed that the students '/^o scored very well on the D.O.E. T^st wore 

■ \ ' ■ 1 

not the same as those who scored well in Mechanics Achievement, ^ score 

derived from the hour and' final exaninations. Neither were those wtio 

scored low on the D.O.E. Te&t the same as those who scored low in 

Mechcinics Acievement. To test the hypothesis that the students wno 

scure high on one or the other knowledge tests were somehow mfere 

similar than those who 'scored low on one or the other of the tests. 
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cocitrasting groups analyses of the D*0*E* Test protocols was carried 
out,^ Protocols of students ^wlio scored highest on the D.O.E. Test were 
contrasted with protocols of students who scored^ lowest on the 
D.O*E» Tefet and protocols of the highest scoring group in Mechanics 
Achievanent were contrasted with protocols, of those scoring lowest. The 
results of the two contrasting groups analyses are shown in Tables 11 
and 12. 

As 3 result of the contrasting groups analyses of the protocols, 
three dimensions along which the high and low scoring students differ 
were identified,' namely: .(1) the frequency of the use of techrjical 
'terms; (2) the frequency with which students give eyider^ that they 
are reflective thinkers (that is, they think about their own thinking 
processes); (3) 'the frequency with which students report that their 
responses to questions are based on knowledge ' rather than on 
observation. These results suggest that, considerin^g the three 
identified dimensions, there is more similarity among students '^A^o score 
v;ell gn either of the mechanics knowledge tests than between those who 
score well and those who score poorly. 
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Discission 

« 

The data analysis reported in the latter part of the Findings 
Section was guided -by the working hypothesis that the D.O.E, Test and 

t- 

the Mechanics Achievement measure based on the Physics 10 course 
examinations were tapping' into two separate knowledge ■ structures. 
These knovdedge structures can be characterized succinctly as (Da 
formal system and (2) a belief system. 

Our current conceptual m'odel of j these systems assumes that the 
formal system is abstract and can be applied to any situation involving 
motion in the macroscopic world. The propositional' knowledge is 
represented formally and the mode of thought (procedural knowledge) in 
this system is formal. 

The formaj. system stands in marked contrast to the belief system, 
which is informal and experience-based . The propositional knowledge in 
this system is bound to specific features of the physical world and, 
therefore, is not applicable to a variety of situations. For example, 
people functioning in this system use the proposition that "lower is 
heavier" to analyze the Atwood Machine and the proposition that 
"heavier falls faster" to analyze the time in free fall of the aluminum 
and lucite blocks. There is evidence in the pr6tocols that in many 
instances propositional knowledge about these • two situatidns is quite 
distinct. Individuals often come up ' with tocally different 
misconceptions to explain their analysis of these tWD physical 
situations,,. The mode of thought characteristic of the belief system may 
be, but is not' necessarily, 'informal. There is evidence in some 
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protocols that' the mode of thought exhibited by a person using the 
belief system is formal. In most .oases, however, there is not 
sufficient evidence to make any valid inferences about the mode of 
thought. Formal thought is always necessary for a person to function in 
the- formal system, and it may or may not be' exhibited by individuals 
functioning in the belief system. 

There is probably considerable overlap in prepositional knowledge 
in the two systems,, especially for those individuals who have had some 
formal instruction in mechanics or who are in the process of learning 
the formalj system. Some interesting (but sparse) data in the study 
stiggest that the belief system has primacy and that certain features of 
a problon .'space may cue the belief system rather thgn the formal 
system.' Three " questions in the mechanics section of the final 
examination concern the Atwood Machine. The questions are reproduced 
in Table 13, and the proportion of students responding correctly to 
each question is noted. Question 12 is e multiple choice version of 
part C of the D.O.E. Test (see Appendix A). The formal analysis of 
question 12 is considerably simpler than the formal analysis of either 
question 13 or 14. Yet less than half as many students answered 
question 12 correctly. This observation suggests that the features of a 
problem cue students to function in the informal belief system. It 
should also be noted here that the manner of administering the 
D.O.E. Test may have been such as to cue the use of the informal system. 
By contrast, the formal system may have been cued by the mechanics 
exanination questions, many of which involve applications of principles 
or generalizations (see Table M), a process requiring formal reasoning. 
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The mcxlel we have postulated is consistent with the finding that 
the score on the Logical Reasoning Test is a predictor of succes in 
classical mechanics as measured by the Mechanics Achievement Score (see 
Table 6) . • The protocol analysis provides another kind of information on 
logical reasoning skill that may have useful implications for 
instruction. In .those instances wliere eVidence of formal tho'ught is 
found in the protocols, it is most often the case- that the person 
either alearly distinguishes his or her observations from inferences or 
is in some other way reflective on his or her own thought processes. 
The student v/ho has this capability will be much more aware of the 
function and value of a formal system for analyzing motion of objects. 
Further, the student \i\o possesses this capability will be better able 
to distinguish between the formal and informal systems and will be less 
likely to revert to the informal system in instances where the problem 
space strongly cues the informal system. 

The^ protocol oXone student is unusUal and interesting with' regard 
to the hypothesized importance of reflective thinking in deriving 
maximun benefit " from physics instruction. TTiis student was- among eight 
students in the lowest group on the D.O.E, Test Correct Response Scores 
(see Table 11),; she answered none of the four key questions correctly. 
However, hers was the single highest total score ' on . Mechanics 
Achievement;^ no student in the entire sample had a higher score. To 
D.O.E. Test question A5 ("On what did you base your answer to question 
observation, knowledge about falling objects, or both?"); she 
answered: 

"Observation, I don't really know any tt]eories, tho' there is something 
in the back of my mind which says that an object falls at a constant 
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rate. I don't know if that's true or not. — As I said above, I based 
it on the idea which may or may not be correct, that objects fall at .a 
constant rate, if they don't have anything obstructing them, or don't 
pass through different mediuus (like air vs. water). 

This student's answer is wrong and is based on a misconception. 

Itowever, because she is reflective about her '?wn thought processes, we 

'might predict on the basis of her protocol that the misconceptions will 

not be deliterious to her learning of the correct concept* 

One instructional consequence of our hypothesized model of the 
formal and informal systems is that physics laboratory experiments and 
demonstrations should not be used in instruction either to verify 
theory or to induce principles. Rather, the laboratory experiments, and 
detnonstrations which .are performed should be utilized primarliy to 
demonstrate the contrasts between the' results of an analysis of 
physical events which is based on common sense and one based, on the 
tenets of the formal system of physics. The instructor should be 
constantly ■ aware that the pr^-instructional ^status of most of the 
students finds them functioning in the informal system. During their 
instruction in -mechanics, the students must make an important shift to 
the formal, system if their achievement in mechanics is to meet the 
instructors' expectations of physics instructors indicated by the typtes 
of examination questions they generally emphasize. Consequently, the 
students need ample opportunities to contrast their informal 
interpretations of physical events with ■ the formal interpretation 
required by the tenets of classical mechanics. 

As shown in the preinstructional assessment, logical reasoning and 
mathematical skills are significantly correlated (see Table 5). 
Nevertheless, some comments should be made with respect to the effects 
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of general mathematics ability and specific mathematical skills on 
student acheivement in mechanic's. We hypothesize that the correlation 
bet'-^^en proficiency in specific mathematical skills prior to formal 
instruction with mechanics achievement can be explained, .in part, by a 
simple analysis of the student's interactions with mechanics 
instruction, in this instance with the lectures. 

The formal derivation and elaborations of the principles of 

mechanics' is achieved by using mathematics as the medium of analysis and 

communication. Thus, for the student to understand the principles of 

mechanics, prior facility with the medium of coimiunication is 

important. In those instances where the student either has little 

knowledge of the mathematics content or lacks facility in certain 

mathematical skills, we hypothesize that more of the student's 

attention will be focused on the mathematics (which is more familiar 

than the mechanics) than on the principles of mechanics. Assuming, a 

finite attention capacity and competing denands of mathematics and 

physics, the student who is facile in the relevant mathematical skills 

clearly is at an advantage in attending to the physics content of a 

lecture. It is notswDrthy that an informal tabulation and analysis of 

the questions asked by students in the physics lectures shows that half- 

of the questions asked in lecture w-»re about mathematics rather than 

physics. For example, in a proulOT on torque, a student asked how to use 

o 

the fact that a certain angle in a right triangle is 30 to fiftd the 
length of a side of the triangle. 

An analysis of the questions that comprise the criterion measure 
of mechanics achievement indicates considerable overlap between the 
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Skills tested for in the Mathematical Skills Test of the 
preinstructional assessment and the mathematics content , of the 
mechanics examinations. Ffowever, this correspondence is. probably not 
the critical one/ The interactive effects of mathematical skills with 
classical mechanics is phobably of prim-'jry ' significance in the. 
students* comprehension of the lectures. 

This analysis has implications .for future research and for 
instructional practice. Microanalysis of the mathematics content of 
both the lectures and the textbook used In the course can provide a 
well-defined set of relevant mathematical skills and an indication of 
the relative frequency of th^eir application during instruction. With 
such a set of basic mathematical skills in hand, it is possible to 
train students to a^ level of nearly automatic performance of the 
skills. The experimental danonstration that student achiev/^r^t in 
mechanics is a function of the level of mathematical skills performance 
would provide empirical evidence to substantiate the proposed 
instructional effects hypothesis. Pending the availability of empirical 
evidence, it may even now be useful to emphasize that 'the ability to 
perfonn mathematical. ski]?.s both accurately and quickly probably is 
very important for the successful learning of mechanics. 

llie more frequent use of technical vocabulary by students who 
score in the high groups in the pre-instructional D.O.E. Test (see Table 
11) and on Mechanics Achievejnent (see Table 12) deserves some further 
discussion. The finding serves as a reminder that prepositional 
knowledge is important in the learning of even hig^ily mathematical and 
formal subject matter, and it may provide some useful insight into the 
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difficuJ-ty students have in learning mechanics. Protocol analysis 
indicates that students v;ho use technical vocabulary often use terms 
incorrectly, that is, when, the criteria Tor dorrectness are t,he 
physicists' definitions for the terms. It is also the case that formal 
relationships among these technical temj^s often are' defined incorrectly 
by the students. Even though the students' precision in using technical 
terms is poor, the frequency of use jnay be a significant factor in 
their learning and retention of classical m^hanics. The propensity to 
use technically relevant vocabulary may be important in itself, or it 
is possible that a minimal knowledge of technical terms, even though 
the I owl edge may be pa^rtial or imprecise, is crucial for comprehending 
the lectures and texts from which the students obtain their 
instruction. 

It is important to note that many of the words tha|t comprise the 
teclmical vocabularly of classical mechanics are words v^i-iich are 
frequently used in natural language. Moreover, there is considerable 
overlap in the meanings of the words in the two contexts. Students 
frequently use a technical word with its natural language meaning in 
the context of formally analyzing the motion of .an object. Overlaps in 
meaning are quite common for mechanics terms, and they may be a source 
of the difficulty students experience in learning classical mechanics. 
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Conclusions 

The data collected for this study provide empirical evidence for 
the assertion that, students have difficulty learnj.ng classical 
mechanics. The fact that having high school physics had no discernible 
effect on the students preinstructional knowledge of mechanics or on 
their success in the course is noteworthy. It is also , important to 
note that the mastery level in the course fdr mechanics Was 51^. These 
data indicate that for' a significant proportion of the student 
population in beginning physics, the instructional challange is 
formidable. Finally, this study has sought to substantiate the 
assumption that fine-grained analysis of students' knowledge* structures 
and of the interaction of features of these knowledge structures with 
instruction can provide valuable insights for the improvement of 
instruction. » . . . ' • 
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Table 1 
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College Years and Majors of Students 




















Year 


in College 


College Major , 








First 


■ 25 (23%) 


Biological Sciences 30 


(27%) . 










Physical Sciences 11 


(10%) 






Second 


43 (39%) 


Pre-Health Related 39 


(36%) 








Professions 












. ^Usually not pre-med 












Mathematics 3 


( ^%) 






Third 


24 (22%) 


Social and Behavioral Sci, 3 


( 3%) 










Humanities 4 


( 4%) 






Fourth 


4 ( 4%) 


Other 3 


( 3%) 






or more 




Unknown or undecided 17 


(15%) 






Unknown 


14 (13%) 












110 


110 












> 









I 



I 
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Table, 2 

Number' of Years of High School Science and Mathematics 

Studied by Students 



Years of H.S. Science Years of H,S. Mathematics 



1 


1 


. ( 1%) 


1 


1 


( 1%) 


2 


6 


( 6%) 


2 


S 


( 5%) 


3 


IS 


(14%) 


3 


14 


(13%) 


4 or more 


82 


(75%) 


4 or more 


83 


'(76%) 


Unknown 


6 


( 5%) 


Unknown 


6 


( 5%) 




110 






110 





0 
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Table 3 

Credits in College Science and Mathematics 
Previously Earned by Students 

Credits in College Science Credits .in Co 11 egfe Mathematics 



0 


12 


(11%) 


0 


19 


(17%) 


1 to 6 


5 


( 5%) 


1 to 4 


41 


(37%) 


7 to 12 


24 


(22%) 


,5 to 8 


33 


(30%) 


13 to 16 


33 


(30%) ^ 


9 or more 


11 


(10%) 


17 to 24 ^ 


15 


(14%) 


Unknown 


6 


( 6%) 


25 to 41 


. 15 


(14%) 








Unknown 


6 


( 6%) 




110 . 





110. 



'ti 



3.9 



Table 4 ' 



Student Behaviors With Repsect to Mechanics 
Assessed on the Hour and Final Examinations 



STUDENT BEHAVIORS 

(A. 3) Knowledge of concepts 

(A. 4) Knowledge of conventions 

(A. 8) Knowledge of prinpiples and laws 

(A. 10) Identification of concepts or 
principles in a new context 

(A. 11) Translation of concepts or 
principles to another' ' 
symbolic form 

(P. I') Application of .knowledge and 
methods to a new problem 



.FIRST HOUR 
EXAMINATION 
Points Pet. 



11 



8' 



20? 



5% 



15%" 



SECOND HOUR 
EXAMINATION 
Points Pet. 



33 



60% ■ 



13% 



13% 



13% 



16 • 53? 



Total 



55 



30 
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Tfiblo 5 

Intercorrehit ion Matrix for Kcclwinics Achiove^i.cnt Score oml Irpiit Vnrlables 







1 


*• 


3 


4 






7 


8 




10 


I, 


MectiniiiS Achievement Score 


3.00 


0.24*' 






-O.OH 


0,01) 


0,09 


o.oy 


0- 14 


0. 13 


2. 


Test Correct Seore 




1.00 


* A* 


0,23* 


A A A 

-0,33 


0,08 


O.OS 


-0,03 


OM)i 


()'. 09 


3, 


i * 

Reason 10)1 Score 






1.00 


0.32 


-0,22* 


-0,04 


0.02 


-o.os* 


-0.07 


0^07 


4. 


Math Ski lis Score 








1.00 


-0.07 


0.13 


0.15 


0.31 


-0.04 


* * 

-P.26 


'5. 


Jiox 


* 




< 




1,00 


-0.02 


0.08 


0.03 


-O.OS 


-0.0? 


6. 


Year-. U.S. Thysi.Cb 












1 . 00 


0.30*** 


* ** 

0.,33 -0,0i^ 


0,02 


7% 


Years II.:;. Science' 














1.00 


0.44*** 


0.18*. 


-0.18* 


8. 


YeartJI..;. Math 




1 












1.00 


0.06 


0. 10 


9, 


Creilit'. i!i)lle|»e Science 


















1.00 


O.IS 



10. Credit*, (ollege Math 



1 .op 



, p < .05 
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Table 6 

Multiple Regressiou Sunuaary Table 
for Prediction of Mechanics Achievement Score 
of Introductory College^ Physics Students 



Variable 
Number and Name 

2. D.O.E. Teist Correct Score 

' 3. Reasoning Score 

4. Math Skills Score 

6,- Sex 



Multiple R 

0.237 
0.378 
0.570 
0.572 



R Square 

0.056 
0.143 
0.325 
0.327 



of Variance 
Explained 

5.6% 

8.7% 

18.3% 



0.2% 



MA = 920,9 + 11.9DC + 33. 7R + 17^.2MS +22.7SX 
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Table 7 



Relationships Tested by Four Key Questions 
on the Demonstration, Observation, and Explanation of Motion Test 



Question Number and Text 



F = ma Relationship Tested 



A4. 



Bl. 



CI. 



When the eraser falls from the red 
mark to the floor, how does its 
speed as it passes the blue mark 
compare with its speed as it 
passes the green mark? 



How does the time it takes for the 
aluminum block to fall .from the 
red mark to the floor compare with 
the time it takes for the lucite 
block to fall from the red mark 
to the floor? 

How does the weight of the bucket 
compare with the weight of the 
block? 



D6. How does the bucket's speed at 
the blue mark comapre with its 
speed at the green mark? 



Bodies in free fall are constantly 
accelerated. 



g 



where g = acceleration due 
to gravity 
F force of gravity 
on the object 

m - mass of the obje 



Two objects of the same shape and 
volume but of different mass have 
the same acceleration in free fall 
Cg is a constant) 



For an unaccelerated system, the 
net force acting on the system 
is zero. 



(when t = 0,%?^ 0) 
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Table d 

Proportions of Corrtct and Incorrtct Responses to Four 
Key questions on the Dettonstration^ Observetioti» an>i 
Expilanation Test by Students Who Did and Did Not 
Study High School Physics 

(H • 105) 



Proportion of ' 
Correct Responses 



Proport)ix)n of 
Incorrect Response^ 



.Studied H.S. Physics 
vs. No H.S. Physics 



Puestion A4 . 

ftext given below) 



Students Who StudieCi 
High School Physics (73) 

Students With No 

High School Physics (32) 

All Students (10$) 



.82 
.75 
• 80 



.18 
.25 
.20 



X • 0,54 
p > .40 



Question Bl > 

Studied H*S. Physics 
No H«S. Physics 
All Students 



.31 
.23 
• 28 



.69 
<77 
.72 



• 0.83 
p > .30 



Qu estion CI* 

Studied H.S. Physics 
No H.S. Physics 
All Students 



.08 
.16 
.11 



.92 
.84 
.89 



p > .20 



Question 06 . 

Studied H.S. Physics 
No H.S. Physics 
All Students 



.71 
,66 
.70 



.29 
.34 

.30 



- 0.58 
p "> .50 



Question Te:<ts; 



A4. When the eraser falls from the red mark to the floor, how does its speed as It 
passes the blue nark compare with its speed as I't passes the green mark? 

Bl. How does the tine 'It takes for the aluoinum block ^to fall from the red mark to 
the floor compare with the time it takes for ^he luclte block to fall from the 
red mark to the floor? 

CI. How does the weight of the bucket compare with the weight of the block? 

06. How does' the bucket's speed at the blue mark corapare with its speed at the 
green mark? 
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Tabu 9 



Misconceptions Excerpted from Student Protocols 
for the D.OfEf Test to Rationalize Their Beliefs 
About tht Velocity of Objects in Free Pall 



Belief A: Th^ velocity of objects in free fall ts constant/ 

(A belief held by students giving '^incorrect** answers 
CP question A4) 

Misconceptions : (from question A6) ' ' 

(S»306) My answer is based on a theory which states that gravity 
pulling on the eraser will have a steady force applied \ 
to it until it lands on another steady state causing 
it toifall at the sane velocity, I'm not sure what exact 
theory it is, if it is at all 

" (S»42l) How fast it drops is det^ri^ined by the eraser's mass- 
which reoains constant af iU Uvels« 

(S»508) The maxinum speed attainable via gravity is 32 ft/sec 

(Sff417] Oi'avitional pull is the saae for each mark. 

(8^440) Gravity pulls down the object at the same speed. 

No natter where, the object would fa^l from the speed 
at any given point would be the same. 

($»3ajl) cFalling objects can reach only a certain velocity when the 
force noving thea is gravity. 

.($#335) TKe eraser falls at a constant rate, i.e. the rate is 

equal when it passes the blue and green. The mass of the • 
^eraser is constant* the force of gravity is also 
constant. Initial rate is zero. 

(Stf436) Gravitiopal forces are independent of relative masses. 

(S<f402) The force of gravity is constant 32 ft/sec. Therefore 
' if it is constantf. the speed of the falling object remains 

constant* The speed and movement of the falling objects 
is due to gravity. 'How fast it drops is determined 
by the eraser's mass * which remains constant at 
all leveU. ' , 



Belief H: Heavier (freely falling] objects fall faster whan lighter 
objects. (A belief held by students giving "incorrect" 
answers to question Bl.) 



Mi scone eption.s : (from question B3) 

(S^Sld) Although the blocks are of equal si:e it is doubtful that 
they are of equal density and weight. Gravity being 
constant, then velocity must be partly dependent on 
, weight and density. Therefore if aluminum is more dense 
and heavier than lucite» then it will fall faster. 

(S«r4l9] Same sized pieces of things have different "weights" • 

that is gravity pulls th-ings according to their molecular ^ 
weights. 

(S#442] The heavier or more dense object, the greater the amount of 
pull or attraction gravity has on it. The aluminum 
block was heavier than the lucite block and ^0 gravity had 
a greater pull on it so it fell faster. 

(Sf*460) The heavier an object the faster it falls. Since lucite is 
denser than aluminiimi if falls faster. 

(S*304) The aluminum is heavier and falls to earth faster due to 
more force. ^ 

(S*418) (No observation) I would say^ however, that the heavier 

object should^hit che ground firdt. Again^ objects falling 
outside a vacuum are subject to air currents etc. Therefore 
the speed of each object is related to its weight* 

(3^433) Aluminum could be a denser substance than lucite^ therefore 
making it fall faster, gravity has greater effect on it* 

sS*463) a • f m The acceleration or speed of an object is dependent 
on the mass of the object and the gravi-tional force* 

(S*312) The ^eater the density, the greater the e^'^ect gravity 
^ has on it. What falls faster ^ feather or a safe. 

(S*403) The heavier the object the fa:5ter the puir^jf gravity. 



Table 10 

Misconceptions Excerpted from Student Protocols for the 
D.O.E, Test to Rationalize Their Beliefs about the 
Weight of Objects' Suspended on the Atwood Machine. 



Belief: The object (block of wood) which hangs lower on the Atwood 
Machine is heavier than the object (bucket of sand) which 
hangs higher. (A belief held by some students giving 
"incorrect" answers to questions CI) 

Misconceptions ; (from question vC3) 

(S/^323) The block of wood must weigh more since it pulled the 

bucket of san^ upward. The block is much more compact and 
bigger than the styrofoam container, containing the sand. 

(S#343) 'For equal, they would be <tqual distance *from pulley but 
block is lower. Same .principle as seesaw, 

(Si^354) If the weight exerted on both was the same, they would 
parallel each other. Gravity h^is greater affect on th^ 
• " block because of its mass. / 

(S/^320) The block is denser than the sand and thereby using the pulley 
as a lever can lift the sand with ease. 



(SM4dl) 



(SM2S) 



(S#427) 



The weight of objectis can be compared by somehow comparing 
the . length of the string of each of the objects when balanced 
over the pulley. 

The pulley was set up somewhat like a scale. The heavier object 
is closer to the grouhd, indicating that It Is heavier. 

A heavy object can be placed farther from the pulley to work 
out a balance, while the lighter object must be farther 
from the ground (force of gravity). 



(5^^309) In order for something to balance, a center of gravity mHSt 
be reached. To obtain this new center heavier objects 
must move further away from the original center and 
lighter objects must move closer. 



(S#315) 



(SNIO) 



(5^419) 



CS#442) 



(5^^423) 



The greater weight on the pulley system will be nearer the 
ground as an equilibrium between the different weights is 
established. 

Weight takes into account the fprce of gravf:y. Since both 
objects are affected by the earth's gravity, (and on the same 
support), comparatively the bucket weighs less* 

Gravity pulls these two objects against one another* 
Met pull on the block is more. 

Because the bucket Is 'lighter, It is able to rest at a higher 
position of equilibrium, the weight of the block brought 
it to this position. 

Because the block is heavier it created an unbalanced force pulling 
harder downward than the bucket whose downward force is less, 
being llgther in weight. 
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Tabid n 

Coapftrlsons of High and Low Correct Response Groups 
on Various Criteria 



Criterion 



High Correct 
Response Group 
(N • 7) 



Low Correct 
Response Group 
(N «8) 



Total Mufflber of Words Used in 
Answer Booklet for O^O.Et Test 

Range 

Group Boan 



227 - 399 
272 



153 - 562 



270 



Frequency of Use of Technical 
Terms in All Responses on 
'D.O.E. Test 

Terms: gravity 

force 

acceleration 

velocity 

equilibrium 

balance 

friction 

Total 

Mean per student 



2d 
13 
13 

4 

3 

2 

2 
65 

9.5 



11 
10 

0 

0 

0 

1 

0 

22 
2,8 



Frequency of Reports of 
Knowledge or Observation Basis 
for Responses to Four Key Questions 
on D«O.E« Test 



Knowledfite basis only 
Knowledge and observation 
Observation basis only 
Not codable 



14- 

S 
6 

0 

All males' 



I 

10 
IS 
6 



Number of Students Whose Responses 
on D.O.E* Test Display Evidence of 
Logical Reasoning 

Logical reasoning 

Illogical reasoning 

No evidence of reasoning 

Not codable 



Number of Students Who Did or 
Did Not Study High School Phy!»ics 

Studied h.s* physics 

No h*Si physics 



ERIC 



Total Score for Mechanics . ihieveinent 
(2 hour exaos plus final) 



Range 

Group rdean 
Standard deviation 



1423 - 1910 

ini 

16S 



i:>:2 • 2046 
1470 
260 



Point biseriai cofrolation - group wit)* «cove * 0.26 



47 



I 



Criterion 



Table 12 

Comparison of High and Low Mechanics Achievement 
Score Groups on Various Criteria 



High Mechanics 
Achioviinent Score Group 
(N « 10) 



Total Number of Word? Used in 
Answer Booklet for 0,0,C. Test 

Range 

Group mean 



164-562 
247 



Low Mechanics ' 
Achievement Score Group 
(N • 10) 



180-385 
243 



Frpquency of U^>e of Technical ^ 
Terms In All. Responses on 
0.0,r.. Test 

Terms: gravity 

force 

acceleration 
velocity 

equ i I Lbrium 

balance 

friction 

Total 

Mean per student 



21 
17 

13 . 

0 
0 
0 
54 
5.4 



17 
11 

2 

2 

0 

0 \ 
0 
32 
3.2 



r rcqucr.cv of Rcjjorts of 
K!;o»»lodgc or Observation Basis 
for Responses to Four Key Questions 
on D.O.c. Test 



vnowlcJ.cc basis only 
Kncv.lcURc and observation 
Cb:5i.rv It • on b.iM*; only 
:.ot i.ouablc 



iq (all male) 
16 
14 

0 • 



I 

23 

16 

0 



'Number of Students Whose Responses 
on 'iJ.O.E.. Tost Display Evidence of 
Logical Reaioning ' 

Logical rca'icninr, 

1 1 logloal i-roasoniag 

evidoni:J of reasoning 

\ot cod.iblo 



4 
1 

S 

0 



0 
0 

10 
0 



*.vai.':r of Students Who nid or 
Did sot Study Hxgli School Physics 

Studied ii.i. ph'-sics 



No r.i. phv<iob 



ERIC 
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Table 13 

Three Questions Concerning th6 Atwpbd Machine 
from the Physics 10 Course Final Examination 



The figure at the right is 
to be used for Questions 
12, 13, and 1 , A and B 
are two masses. They are 
connected by a very long 
massless string which 
passes over thei pulley. 
There is a small amount 
of friction in, the pulley. 
The pulley has a small 
mass. 




12. If the masses in the figure remain at rest, 
what can be said of them? 

a^,. B's mass is a little bit greater than 
A*s mass. 

b) A«s mass is a little bit greater than 
B's mass. 

c) A and B have nearly the same mass but 
one cannot^ say which if greatelr. 

. d) Nothing at all can be Said about 
their masses. 

13. If B is descending at a constant velocity, 
what can be said of the masses? 

B's mass is a little bit greater than 



Proportion of Students 
Answering Question Correctly 



0.33 



a) 
b) 
c) 
d) 



A's mass. 

A's mass is a little bit greater tharT''"^ 
B's mass. 

A and B have nearly the same mass but 
one, cannot say which is greater. 
Nothing at all can be said about their ~ 
masses. ^ 



0.72 



14. 



FRIC 



If B is descending at a constant velocity, we 
can expect that 

a) it will keep on descending at constant 
velocity until it hits the floor or 

A hits the pulley, 

b) It will slow down and gradually come to 
a stop unless it first hits the floor 
or A hits the pulley^ 

c) it will speed until it hits the floor 
or A hits the pulley. 

d) Nothing can be said without more 
specific information, 

\ 
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red 



blue 



BnD 



green 



u 

8 



i 



(a) Wooden pole with markers 



pulley 
(diameter 9 cm) 




nylon string 



bucket 
of sand 





support rod 



wooden block 
(7,5 cm X 5 cm X 5 cm) 




(b) Atwood machine 



Figure 1. Apparatus used in the DGn^onstration, Observation, and Explanation of Motion Test* 
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Appendix A 

Questions in Answer Booklet of the Demonstration, 
Observation, and Explanation of Motion Test, 

.Listed below are the questions included in the answer booklet for 
the Demonstration, Observation,- and Explanation of Motion Test which 
was used as a preinstructional measure of students' interpretation of 
the motion of objects in the present study. This listing contains addi- 
tional identifying information about the several test sections and parts 
that does not appear in the actual answer booklet. The spaces where 
Students write responses between questions in the answer booklet also, 
have been eliminated. 

Section A - Free Fall (one bbject) 

Question s 

A, !♦ What did you observe? 

A. 2. What sets the eraser in motion? 

A. 3. Why does the eraser not start moving when the pa^ is under it? ' 

A. 4. When the eraser falls from the red mark to the fjloor, how does its speed 
as it passes the blue mark compare with its speed as it passes the 
green mark? 

A. 5. On what did you base your answer to question 4-*observation, knowledge 
about falling objects, or both? 



If you based your answer to question 4 on some knowledge, explain which 
information, theories, or generalizations you used to arrive at your 
answer. 



» < 



' . Section B - Free Fall 

(two objects of the same size but different 
mass; released simnUaneously) 



Questions 



^ B. 1. How does the. time it takes. for the aluminum block to fall ^rom the red 
. ' mark to the floor. compare viith the time it takes for the lucite block 

•to fall from the red mark to the floor? 

2^ 'On what did you base your answer to 'question 1— observation, knowledge 
about falling objects, |or both? 

' . ■ ■ . \ , . - • 

^ B. 3. If you based your answer to question 1 on some knowledge, explain 'which 
^ , - informdtioh, theories, or generalizations you used to arrive at your 

answer. " " * ^ 



Section C - Atwood Machine 
(different; objpct;s of- the same mass; system static) 

Questions , ■ ^ 

1. How does the weight of the bucket compare with the weight of the block? 

Co 2 4 On what did you base your answer to question ,l-—6bservation, knowledge 
about falling objects, or both? 

C. 3. If you based your answer to question 1 on some knowledge, explain 
which information, theories, or generalizations you used to arrive 
at your answer* ^ 
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Section D - Atwood Machine 
(different masses; system in motion) 



Part It - Grains of Sand . 
Questions 



!• Prediction 



D. 2 , On what basis did you make your prediction ? 
3* Ob servation - (15 grains of sand) 



Part D> II, - Scoop of Sand, 
Questions 

4, When a full scoop of sand was added to the bucket, was the bucket's motion 
different fran its motion when 15 grains of sand were added? If so, 
describe the differences you observed. 



D, 5, How do you explain any difference you observed? 



PdTt Ill , - Speed • 
Question s 

, How does the bucket *s speed at the blue mark compare with its speed 
at the green mark? 

On what did you base your answer to question 6 — observation, knowledge 
about falling objects, or both? 

; 

If you based your answer to question 6 on some Knowledge, explain 
which infonnation,, theories, or generalizations you used to arrive at 
your answer. 

Part D, IV , - Two Scoops of Sand 
Questions ^ 

0, 9, How does the bucket's speed at the blue- mark with 2^ extra scoops of 
sand compare with its speed at the blue mark with 1 extra scoop of 
sand? • 

\ 

D. 10. Make up a rule which states how adding ^sand affects the rate of fall 
of the bucket. 

5:-3 



D. 6. 

D. 7. 
D. 8. 



V 



Section E - Atwood Machine 
(different objects of equal mass; 
system in motion at constant speea) 



Ouestion'i 



E. It How does the weight of the bucket compare with the weight of the block? 

Ec 2. There are two forces acting on the bucket: the downward force due to 
gravity and the upward force due to the string. Is the downward force 
due to gravity 

(a) equal to 

(b) greater than 

(c) smaller than 

the upward force of the string? My answer is ^ 

Eo 3. There are two forces acting also on the block: the downward force due 
to gravity and the upward force due to the string. Is the downward 
force due to gravity 
• (a) ' equal to 

(b) greater "han 

(c) sni^ller than My answer is 

the upward force due to the string?. 



E. 4. Is the force of the string on the block 

(a) equal to 

(b) greater than 

(c) smaller than 

the force of the string on the bucket? My answer is 



Eo 5. ' Is the force of the gravity on the block 

(a) equal to 

(b) greater than 

(c) smaller than My answer is 
the force of gravity on the backet? 



ER?C. 



Section T - Atwood Machine 
(with cylinders of equal mass;, 
system in motion at constant speed) 



Questions 

« 

Fo 1. Why does the cylinder move dovm? 

2 . Why does the cylinder continue in motion after the push stops? 

Section G - Atwood Machine 
(transfer of string and cylinders) 

Questions 

G* 1. Prediction 

•J 

«' • 

Go 2, What are the reasons for your prediction? 

Go 3. . If your prediction was incorrect, go to question 3a, 
If your prediction was correct, go to question 3b, 

5ao l^at reasons can you give now to explain your observation? 
5b, Do you want to add any comment about your obsei^vation? 



